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IV.  Scientific  Progress  and  Accomplishments 

Classification  of  targets  based  on  forward-looking  infrared  (FLIR)  imagery  is  complicated  by  the  fact 
that  the  associated  imagery  is  a  strong  function  of  the  target-sensor  orientation  (pose).  Due  to  this 
nonstationarity  of  FLIR  imagery  as  a  function  of  target-sensor  orientation,  it  is  difficult  to  design  a  single 
classifier  for  a  given  target,  and  therefore  we  define  target  classes.  A  target  class  represents  a  set  of  target¬ 
sensor  orientations  over  which  the  associated  FLIR  imagery  is  approximately  stationary.  Each  target  is 
characterized  by  multiple  classes.  Moreover,  the  imagery  associated  with  a  given  target  class  can  vary 
significantly,  representative  of  variation  in  the  target  thermal  properties.  For  example,  the  FLIR  image  of  a 
target,  at  a  fixed  target-sensor  pose  can  vary  significantly  depending  on  the  target  history  (e.g.  whether  the 
engine  is  on,  how  long  the  engine  has  been  on/off,  target  motion,  etc.). 

One  of  the  principal  challenges  in  processing  FLIR  imagery  involves  designating  a  feature  vector,  from 
which  one  achieves  data  compression.  The  objective  is  to  retain  as  much  of  the  discriminatory  information  as 
possible  from  the  original  image,  while  simultaneously  reducing  the  degrees  of  freedom.  In  the  work  reported 
here  the  features  are  tied  to  particular  subregions  on  the  target,  each  of  which  ideally  has  distinctive  thermal 
properties.  For  each  such  subregion  a  set  of  templates  are  designed,  based  on  a  Karhunen-Loeve  (KL)  transform 


of  the  training  data  (as  in  a  principal-components  analysis).  The  dimensionality  of  the  feature  vector  is  tied  to 
the  number  of  subregions  considered. 

We  investigate  two  techniques  for  designation  of  the  subregions.  In  one  approach  the  subregions  are 
designated  explicitly,  based  on  a  manual  analysis  of  the  associated  FLIR  imagery.  The  extraction  of  a  given 
target  subregion  can  be  viewed  as  implementing  a  simple  weighting  filter:  those  parts  of  the  image  associated 
with  a  desired  subregion  are  weighted  by  one,  with  the  remaining  portions  of  the  imagery  weighted  by  zero. 
Each  subregion  has  an  associated  weighting  filter.  As  an  alternative  to  this  manual  approach,  we  have  also 
designed  weighting  filters  based  on  an  independent-components  analysis  (ICA)  of  the  available  training  data. 
This  process  emphasizes  those  portions  of  the  FLIR  image  for  which  the  associated  ICA  weighting  filter  is 
large,  while  de-emphasizing  the  other  regions.  In  this  case  the  weighting  filter  is  no  longer  binary,  and  the 
number  of  ICA  components  used  is  analogous  to  the  number  of  subregions  considered  in  the  manual  approach. 

Having  constituted  a  feature  vector,  the  classification  is  performed  via  a  support  vector  machine  (SVM), 
such  being  the  subject  of  considerable  interest  recently  in  the  classification  community.  An  SVM  is  typically 
applied  for  binary  classification  problems,  while  here  we  are  interested  in  classifying  multiple  target  classes. 
We  consider  two  techniques  for  implementing  the  SVM-based  classification  of  Nc  classes  (Nc> 2).  In  one  we 
build  Nc  SVMs,  one  for  each  class.  Classifier  m  is  used  to  specify  a  decision  surface  in  feature  space  between 
class  m  and  all  the  other  Nc- 1  classes.  This  approach  has  limitations,  principally  because  the  size  of  the 
associated  feature  vector  grows  linearly  with  Nc.  We  therefore  also  consider  an  alternative  approach,  in  which 
we  design  NC(NC- 1)/2  simpler  SVM  classifiers,  for  which  the  feature-vector  dimensionality  does  not  grow  with 
increasing  Nc.  While  the  number  of  such  SVM  classifiers  grows  in  a  quadratic  fashion  with  Nc,  each  associated 
SVM  is  considerably  simpler  than  in  the  former  approach.  The  performance  of  these  two  approaches  is 
examined  based  on  the  processing  of  measured  FLIR  imagery. 

V.  Technology  transfer 

The  research  reported  here  has  been  executed  in  close  coordination  with  the  US  Army  Research  Laboratory 
(Adelphi,  MD).  All  of  the  research  reported  here  has  been  transitioned  to  ARL. 


